Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[query] Support zstd compression in BGEN files #12576

Merged
merged 2 commits into from Jan 13, 2023

Conversation

tpoterba
Copy link
Contributor

@tpoterba tpoterba commented Jan 6, 2023

CHANGELOG: hl.import_bgen and hl.export_bgen now support compression with Zstd.

CHANGELOG: `hl.import_bgen` and `hl.export_bgen` now support compression with Zstd.
Copy link
Collaborator

@chrisvittal chrisvittal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One small maintainability issue around the ids for compression.

val writeHeader = exportType == ExportType.PARALLEL_HEADER_IN_SHARD
val partWriter = BGENPartitionWriter(tm, entriesFieldName, writeHeader)
val compressionInt = compressionCodec match {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there any way to make this some kind of enum, or if that's too much, named constants?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done.

@danking danking merged commit eee0924 into hail-is:main Jan 13, 2023
danking pushed a commit to danking/hail that referenced this pull request Jan 30, 2023
* [query] Support zstd compression in BGEN files

CHANGELOG: `hl.import_bgen` and `hl.export_bgen` now support compression with Zstd.

* address comments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants